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PREFACE 

The central question of this dissertation is 
whether an objective ranking of utility to the decision 
maker can be assigned to the form of the presentation to 
him. In this instance we are interested in whether an 
executive decision can be reached earlier, faster or more 
consistently with a computer-driven display device than with 
the more customary printed material. 

An experimental group of eighteen management- lev el 
subjects with extensive experience in inventory control 
was assembled for a two-week short course in advanced 
inventory management techniques. During the short course, 
the subjects were exposed to simulated results from 
computer application of certain inventory control policies 
to a hypothetical inventory system handling n items. This 
system is faced with a certain randomly derived set of 
orders, price changes, replenishments of stock and other 
transactions. The results of the simulation were presented 
on both printer paper and on a cathode ray tube display 
device. For each method of presentation, results were 
represented in both tabular and graphical form. 

When a substantial part of the course had tran- 
spired, the subjects were asked to evaluate the results of 
simulating two inventory systems, using printer output for 
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one evaluation and the cathode ray tube display device for 
the other evaluation. By means of a Latin square design 
and rank order statistics these evaluations were inspected 
to determine if experienced decision-makers using a display 
device could reach a decision that was earlier, faster or 
more consistent than a decision reached by means of printer 
output . 

The results indicated, with very high statistical 
significance, that a decision could be made faster with a 
display device, and with high significance that a decision 
could be made on the basis of less information by 
means of the display device. Other results pointed to 
decisions that were more consistent for the Individual and 
which tended more to agree with the rest of the group when 
display device techniques were used for the evaluation of 
the inventory systems. 
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I . INTRODUCTION 



The central question of this dissertation is 
whether an objective ranking of utility to the decision 
maker can be assigned to the form of the presentation to 
him. In this instance we are comparing the utility of a 
cathode ray tube display to printed material, and are 
interested in whether an executive decision can be reached 
earlier, faster, or more consistently with the display 
device than with the more customary printed material. 

In order to provide a vehicle for the experiment, 
and to establish an environment for a discussion of the 
results, a simulator was written for computer application 
of certain inventory control policies to a hypothetical 
inventory system handling n line items. This system is 
faced with a certain randomly derived set of orders, price 
changes, replenishments of stock, and other transactions. 
This simulator is governed by a number of pseudo-random 
variate generators and by program constants. These para- 
meters are set by the user. An Important set of these 
parameters establishes the management policy for inventory 
control. A policy is formalized by the selection of a 
combination of three policy components from among: 

1. Two service rules to be used in variable safety 
level computation. 
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2. Two smoothing constants to be used in demand 
forecasting by exponential smoothing. 

3. Three purchase quantity computation rules. 

A Cartesian product of these three sets gives a total of 
twelve inventory control policies to be investigated. The 
simulator exercises each of the twelve policies for a 
period of twenty-four months of generated transactions . 

At the end of each of the simulation months, relevant 
statistics are gathered about the system performance under 
each policy set. In order to insure uniform interpretation 
of the statistics, each policy set is exercised under 
identical initial conditions. 

Due to the large number of parameters which are 
available to the user, the simulation program provides a 
versatile vehicle for this investigation. The statistics 
which the program develops are quite extensive, and only 
part of these data are used in the investigation. Although 
the simulation program and its results are of interest in 
their own right, the present investigation uses the simu- 
lator as a vehicle rather than the object of investigation. 

Based on the data presented to him by the simulation 
program, the decision maker is expected to make a series of 
decisions. At the end of each simulation month, he ranks 
the policies in the order of acceptability to him. Each 
decision maker thus produces a set of twenty-four ordered 
lists of twelve policies each, from which conclusions will 
be drawn concerning the form of presentation of the data. 
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The experiment was conducted in the context of a 
short course in advanced inventory control techniques. 

A class of eighteen interested and experienced people in 
the inventory control field met for two weeks during 
August 1968, for twenty class hours of instruction under 
the auspices of the Department of Computer and Information 
Science at the University of Worth Carolina in Chapel Hill. 
During the course the following topics, among others, were 
treated « 

1. Exponential and weighted time series smoothing 
for demand forecasting. 

2. Probability distributions of demand. 

3. Evaluation of order-quantity computations. 

4. Variable safety level concepts. 

5. Performance budgeting. 

6. Master record file design. 

Wear the end of the course, each participant was given, as 
examination problems, the statistics resulting from two 
different simulation runs. The participants were asked to 
rank the various management policies, month by month and 
to make other decisions regarding the policies, on the 
basis of the data presented. Each participant acting in 
the capacity of decision maker, or decider, using both 
printer output on one problem and graphic display presen- 
tation on the other, demonstrated his decision making 
ability . 

The statistics from the simulation program were 
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displayed in a variety of formats on standard computer 
printer paper. The statistics included such data as 
percent availability of stock, number of purchase orders 
generated, lost sales and total dollar investment in 
inventory. The output was in the form of tabular listings 
and bar .-graphs. Also, for each problem, the IBK 2250 
cathode ray tube display unit was programmed to show the 
same data as appear on the printer output, in fundamentally 
the same listing and graphical formats. Thus the exper- 
iment did not attempt to establish the relative effective- 
ness of listed versus plotted data. Instead it investi- 
gated the relative effectiveness of printed versus display 
presentation of such data. The display unit was under the 
control of the decider, who was able to specify which of 
the twenty-four months and the title of the displayed data 
which he wanted to see. In both display and printer output 
cases, he was expected to start at the first month and 
proceed through the months in order. 

The course participants were divided into two test 
groups, each group consisting of nine individuals chosen 
at random. Tests were made in regard to: 

1. Are decisions made faster? The elapsed clock 
time to decide on a ranking of policies which 
the decider would be willing to commit himself 
to for future action was tested. 

2. Are decisions made earlier? The calendar month 
(out of the twenty-four months of simulation) 
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in which the decider feels he has enough data 
to commit himself to a ranking for future action 
was tested. 

3 . Are decisions made faster? The elapsed clock 
time to complete the remainder of the problem 
was tested. After committing himself to a 
ranking, the participant continued the problem 
through the twenty-fourth month. 

4. Are decisions made more consistently? Individ- 
ual correlation coefficients from the Spearman 
rank correlation test were computed. 

5. To what degree do the members of each group 
agree among themselves in regard to the 
rankings? Kendall's VJ coefficient of concord- 
ance was computed for each cell of the Latin 
square . 

In summary, the decider makes tvxo basic kinds of 
decisions. He decides on a ranking at each month in turn, 
and he decides whether or not to indicate at this month 
that he feels confident enough of his ranking to predict 
that it will not significantly change over the remainder 
of the twenty-four months. 

The resulting ordered lists of policy sets and the 
preparation times were analyzed in two basic ways. First, 
a 2 x 2 Latin square design with repeated measures was 
used in an analysis of variance. Rank order statistics 
Ttfere then used to test the consistency of each individual 
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decision maker and the concordance of a group of decision 
makers . 

The statistical analysis of variance explored the 
differences between , graphic and printed data presentation 
(treatment), between the first and second problems done by 
each participant (order), and isolated the differences 
between the performance of Group I and Group II. 

The rank order of the policy sets at the decision 
month and at the end of the twenty-four month simulation 
was compared by the Spearman rank correlation coefficient 
test for each participant. These rank correlation 
coefficients were then arranged in the Latin square and 
an analysis of variance was performed. These tests 
determined whether treatment, order, or group composition 
caused differences in the consistency of a participant's 
final answer, after he had full data available, with that 
at the month of commitment to a policy ranking. A 
Kendall's coefficient of concordance was computed to 
measure how well the rankings produced by each test group 
on each problem at the decision month agreed among 



themselves . 



II. THE SIMULATION MODEL 



This simulation program is a dynamic model of a 
general inventory control situation, and is intended to 
investigate inventory management policies in regard to 
forecasting, purchase quantity computation and service 
level over a range of items whose characteristics are 
defined by the user. The model was programmed in PL/I 
utilizing the IBM System 360 Model 75 at the Triangle 
Universities Computation Center, Research Triangle Park, 
North Carolina. 

The model establishes identical initial conditions 
for each of the twelve policies and then generates a 
series of actions which represent daily business trans- 
actions under a particular policy. This series of daily 
actions is continued over a simulation cycle of two 
360-day years for each policy in question. Reports are 
generated after each thirty-day month of simulation. 

The Cartesian product of the sets of decision 
rules for service level (two rules), purchase quantity 
computation (three rules), and forecasting methods (two 
rules), gives twelve distinct cycles of 720 simulation 
days each. 

The following are the formal properties of the 
simulation model. While the program is well documented 
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in the program listing, the tabulation below of the more 
important elements defines the model by a categorization 
appropriate to the simulation of economic systems. ^ We 
will define exogenous variables as those independent 
parameters which are treated by the system as inputs. 

They will, in general, be stochastic variables which are 
generated internally by the program's random variate 
generators. Status variables will describe the state of 
the system in relation to an appropriate time period, and 
are generally found to be in a feedback loop which inter- 
acts with the exogenous variables of a preceding time 
period. For instance, the on-hand inventory level, ONH, 
reflects a status at any one point in time, but is 
dependent on the values of several stochastic variables in 
preceding time periods. Endogenous variables will be the 
output result of interactions between exogenous and status 
variables. These are the numerical results which are 
found on the printed and cathode ray tube display output. 
Where status variables describe the system and interact 
with other variables, endogenous variables are collection 
points for output purposes only, and do not interact with 
other variables to affect system performance. Identities 
will be either definitions or tautologies which describe 
model components. For example, the status variable ONH 

^Thomas H. Naylor, et al,, Computer Simulation 
Techniques (New York* John Wiley & Sons, Inc,, 1966 ), 
pp. 9 - 20 , 159-173. 
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is defined by the identity ONH = ONH - TRANS + DUIN, where 
the identifier on the left at time t + 1 is replaced by the 
expression on the right evaluated at time t. Parameters 
are those variables which define the inventory control 
policies and the distributions describing the environment 
under investigation, as distinguished from the exogenous 
variables that describe the particular experiences to which 
the policies are subjected. These the investigator changes 
in order to model his particular policies and simulated 
environments. In all cases the identifier mentioned is 
the one used in the PL/I program and is cross-listed in the 
Program Attribute Table. 



EXOGENOUS VARIABLES 



Identifier 



Description 

A uniformly distributed random 
variate in the range 0 to .99* 



RAND 



Y 



A random variate from one of the 
ten random variate generators. 



X 



A number in the range one to ten 
which indicates which of the ten 
random variate generators (see 
page 20) is being called. 



STATUS VARIABLES 



Identifier 



Description 



ONH 



On hand inventory; in units of 
issue per line item. 



HQTY 



Amount due in from purchase 
action initiated by a purchase 
quantity computation; in units of 
issue per line item. 
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.fSOLD 


Total units sold the previous 
year; in units of issue per line 
item. 


RET 


Total units returned by customers 
over the simulation cycle; in 
units of issue per line item. 


FREQ 


Frequency of satisfied demand 
this year; in number of demands 
satisfied per line item. 


CRIT 


Reorder point (variable safety 
level); in units of issue per 
line item. 


TOTD 


Total demand last year; in units 
of issue per line item. 


CDF 


Count-down variable which shows 
the number of days until a due- in 
order is expected to be received 
for this stock number; in days. 


ERD 


Forecast monthly demand; in units 
of issue per line item. 


AUF 


Annual usage (sales this year); 
in units of issue per line item. 


AMD 


Total demand this year; in units 
of issue per line item. 


MFREQ 


Frequency of demands which could 
not be filled; in number of 
demands per line item. 


MDEM 


Demand this month; in units of 
issue per line item. 


DSHD 


The demand registered against a 
stock number on any particular 
transaction; in units of issue 
per line item. 


TRANS 


The number sold to a customer as 
the result of a demand; in units 
of issue per line item. 


BN PR ICS 


The computed cost price of on- 
hand inventory after receipt of 
due-in merchandise; in dollars 
per unit of issue. 
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NEX 



FCST1 

TRND 

ERROR 

TREND 

EXPCDMD 

MAD 

MRD 



The mean of the number of units 
returned, by a customer against a 
stock number; in units of issue 
per line item. 

Forecast demand at previous time 
period; in units of issue per 
line item. 

Demand trend; in units of issue 
per line item. 

Error in forecast of demand 
during last time period; in units 
of issue per line item. 

Smoothed trend forecast; in units 
of issue per line item. 

Expected demand after trend 
correction to forecast demand; in 
units of issue per line item. 

Mean absolute deviation of true 
demand from expected demand; in 
units of issue per line item. 

Maximum reasonable demand from 
variable safety level computa- 
tions; in units of issue per line 
item. 



ENDOGENOUS VARIABLES 



Identifier 

AVAIL 

AV$INV 

LOSS 

PURCH 



Description 

Availability, the ratio of units 
of satisfied demand to units of 
total demand; in percent per 
policy. 

Total inventory investment, the 
cost of the on-hand inventory 
plus due-in; in dollars per 
policy. 

Lost sales, the cost of not 
having stock which was demanded 
over the life of the simulation; 
in dollars per policy. 

Cumulative number of purchase 
actions generated; in number of 
purchase actions per policy. 
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3 CLITEM 



S CLITEM 



S CLITEM 



3 CLITEM 



S LKITEM 



S LNITEM 



S LNITEM 



S LNITEM 



S LNITEM 



S LNITEM 



S LNITEM 



The 



(1) Total of Items with unit price 

less than 325.00 and annual 
demand less than $100.00; in line 
items per policy. 

(2) Total of items with unit price 

less than $ 25.00 and annual 
demand > $100.00 and 4 $1,000; 
in line items per policy. 

(3) Total of items with unit price 4 

$ 25.00 and annual demand > 

$1,000; in line items per policy. 

(4) Total of items with unit price 

over $ 25 . 00 ; in line items per 
policy. 

(1) Total of items with availability 

470 percent; in line items per 
policy . 

(2) Total of items with availability 

> 70 percent to 4 75 percent; in 
line items per policy. 

(3) Total of items with availability 

> 75 percent to 4 80 percent; 
in line items per policy. 

(4) Total of items with availability 

> 80 percent to 4 85 percent; in 
line items per policy. 

(5) Total of items with availability 

> 85 percent to 4 90 percent; in 
line items per policy. 

(6) Total of items with availability 

> 90 percent to 4 95 percent; in 
line items per policy. 

(7) Total of items with availability 

> 95 percent; in line items per 
policy . 

IDENTITIES 



following identities are expressed in terms of 



a programming language assignment statement, where the 
identifier on the left at time t + 1 is replaced by the 
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expression on the right, evaluated at time t. 



TRANS 


= DI-'iD if total demand satisfied, else 

TRANS = ONH; in units of issue per line 
item. 


#SOLD 


BK 

= TRANS; in units of issue per line 

1 item. 


BN PRICE 


= ONH * PRICE + BQ * DUIN; in dollars per 

ONH + DUIN line item. 


PRICE 


= BNPRICE; in dollars per line item. 


ONH 


= ONH - TRANS + DUIN; in units of issue 

per line item. 


DU IN 


= HQTY + (TIME/30) * PRD; in units of 

issue per line item. 


PRD 


= PRD * (1 - BCONSTANT ) + MDEM * 

BCONSTANT; in units of issue per line 
item. 


HQTY 


= ^12 * HORDERCOST * AUF for EOQ; in units 

1 HHOLDCOST 

of issue per line item. (Other 
decision rules for HQTY are outlined 
in text . ) 


EXPEC 


= AND/(FREQ + NFREQ) ; in units of issue 

per line item. 


STDV 


= EXPEC/2 ; in units of issue per line 

item. 


HEX 


= AND/FREQ; in units of issue per line 

item. 


MDEM 


32 

= DEMD; in units of issue per line 

BD = 1 item. 


STDX 


= NEX/10 ; in units of issue per line 

item. 


TRND 


= PRD - FCST1; in units of issue per line 

item. 


TREND 


= (BCONSTANT * TRND) + (1 - BCONSTANT) * 

TREND; in units of issue per line 
item. 



14 



ERROR 


MDEM - EXPCDMD; in units of issue per 
line item. 


EXPCDMD 


PRD + TREND * (1 - BCONSTAIIT)/ 
BCONSTANT; in units of issue per line 
item. 


MAD 


ABS (BCONSTANT * ERROR) + (1 - 
BCONSTANT) * MAD; in units of issue per 
line item. 


MRD 


( (TIME/30) * EXPCDMD) + KFACT * MAD * 
3QRT (TIME/30); in units of issue per 
line item. 

PARAMETERS 


Identifier 


Description 


PRICE 


Cost price of inventory item; in 
dollars per unit of issue. 


TIME 


Purchase lead time; in days per 
purchase order per line item. 


BCONSTANT 


Exponential smoothing constant; 
a decimal fraction. 


ESAFE 


Fraction of demand unsatisfied, 
for use in variable safety level 
computation; a decimal fraction. 


BYRC 


Number of years in total time 
period of simulation; in years 
per simulation cycle. 


BD 


Number of days per month; a 
numeric constant in the range 
one to thirty. 


HORDERCOST 


Order cost; in dollars per 
purchase action. 


HHOLDCOST 


Holding cost; in dollars per 
year. 


HMAX 


Maximum purchase quantity; in 
units of issue per transaction. 


HMIN 


Minimum purchase quantity; in 
units of issue per transaction. 



HANNUAL$DMD 



Annual dollar demand comparand 
for purchase quantity compu- 
tation; in dollars per year. 
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In order to provide for future demands against 
inventory, it is usual to use past demand history as a 
basis for forecasting this future demand. In this model, 
exponential smoothing^ was used to operate on past and 
present demand to produce a forecast demand for use in 
purchase quantity and safety level computation. Single 
exponential smoothing is defined to be: 

Y t = <*X t + (1-*) Y t _i 

where is the average computed for the end of time 
period t and X t is the demand registered in time period t. 
The smoothing process can be recursively applied, 
yielding higher degrees of smoothing expressed by: 

*t = + (l-oO y£_-l 

where k is a superscript which defines the degree of 
smoothing, and t indicates the time period in question. 
Double smoothing, for example, requires the following 
calculations : 

Y t - * x t + W-oO Y t-i 
x t = + Y ii 

While of interest for theoretical purposes, high 
orders of smoothing in general provide little practical 

p 

Robert G. Brown, Statistical Forecasting for 
Inventory Control (Nexu York: McGraw-Hill Book Company, 

1959), pp. 45-51. 
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benefit in terms of forecast accuracy, and obviously 
increase file storage space requirements and computation 
time. For these reasons, only single and double smoothing 
have been used in the model. 

From the definition, however, it can be seen to be 
a trivial matter in PL/I to program a recursive function 
call for any desired degree, assuming the availability of 
k storage locations with each master file stock item for 
k^ h degree exponential smoothing to hold the k values of 
Yk. 

The specification of two alternative values for the 
oC-constant in the forecasting routine is at the option of 
the user. For preliminary investigation, values of 0.2 and 
0.4 are customary, but, of course, any values may be 
specified. The specification of the -constants completes 
the first of the three sets of parameters needed to iden- 
tify the twelve policies to be simulated. 

The second set of parameters controls the purchase 
quantity computation. Here three choices are available for 
composing the twelve-policy set and the user may either use 
the three decision rules embedded in the program, specify- 
ing their parameters as desired, or entirely new rules may 
be specified in any combination with little additional 
effort. 

When the stock on-hand gets to a certain level 
(CRIT) a computation is made to determine how much to 
purchase to replenish this stock. This aperiodic action 
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was taken in lieu of a periodic reorder cycle on the 
assumption that we are dealing with high demand items 
(as opposed to insurance items) and that if there is new 
information, use should be made of it. This new infor- 
mation is in the form of the variable safety level (CRIT) 
and the total demand forecast. This philosophy could have 
been carried one step further and a new exponentially 
smoothed demand produced at this point, but with monthly 
forecasting in use this was deemed unnecessary. The 
purchase quantity computation methods xvere chosen in order 
to provide three quite distinguishable computations so as 
to give clear alternatives in the evaluation of the 
results. The purchase quantity computation methods chosen 
to model weres 

1. Standard EOQ computation^ with: 

HORDSRGOST = Order cost = 370. 

HHOLDCOST = Holding cost = 15 percent of price. 

AUP = Annual demand from master file. 

HMAX = Maximum buy = twelve months of forecast 
demand, 

HMIN = Minimum buy = one month of forecast 
demand . 

2. Modified EOQ computation with different para- 
meters in order to accentuate any distinction 
with the standard EOQ computations 

3g. W. Plossl and 0. W. Wight, Production and 
Inventory Control (Englewood Cliffs, N. J.s Prentice-Hall, 
Inc., 1967), PP. 388-390. 
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KORDERCOST = Order cost = $100. 

FI MAX = Maximum buy = twenty-four months forecast 
demand. 

H^OLDCOST = Holding cost = 15 percent of price. 
HMIN = Minimum buy = two months forecast demand. 
The decision rule for the modified EO^ computation was to 
use the standard E03 formula with the above parameters if 
the forecast annual demand in dollars was less than .$1,000. 
If the annual demand forecast was equal to or greater than 
$1,000, but less than $10,000, the purchase was to be 
simply twelve months of predicted demand. Otherwise the 
standard EOQ formula was used with the above parameters 
except that HORDERCOST = $500. 

3. Three way function of annual dollar demand 
forecast ! 

1) If forecast dollar demand is less than 
$1,000, buy twenty-four months of forecast 
demand . 

2) If forecast dollar demand is equal to or 
greater than $10,000, buy two months of 
forecast demand. 

3) Otherwise buy six months of forecast demand. 
These three methods represent enough of a variation so 
that the results show significant differences from which 

to choose. Of course any other set of purchase quantity 
computation methods could have been chosen. Since the 
number of simulation cycle runs is dependent on the 
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Cartesian product of the overall number of rules in each 
set under consideration, the addition of more rules must 
be considered with total run time in mind. 

The third and last set of rules involves a choice 
of two performance levels or service levels.^ The service 
level is in essence the desired availability of stock in 
the system. For instance, a service level of 90 percent 
indicates that the system economics are expected to be 
able to satisfy 90 percent of the demand against system 
items. The parameter BSAFE may be set to reflect two 
different service levels which are to be investigated. If 
service level is defined as fraction of demand to be 
satisfied from stock, BSAFE will be defined as fraction of 
demand unsatisfied, or fraction of demand back ordered. If 
we are investigating the feasibility of system support for 
service levels of 95 percent and 98 percent, the values of 
the parameter BSAFE would be specified as 0,05 and 0.02, 

The principal use of this parameter is in the computation 
of the variable safety level, ^ CRIT. This safety level, 
or reorder point, varies with each item as the item's 
demand pattern changes. The variable safety level compu- 
tation takes into account past forecast errors and produces 
a small safety level of stock for a well behaved demand 
pattern and a large safety level for a demand pattern 

A . 

Brown, Statistical Forecasting , pp. 105-116. 

5 Ibld . . pp. 136-159. 
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which produces large forecast errors. The variable safety- 
level computation is accomplished monthly, at forecast 
time, for each stock item in the file. 

For the purposes of this model, an inventory control 
policy was defined to be one of the twelve possible com- 
binations made by selecting one element from each of the 
above three sets of parameters. For example, one policy 
might be oC= .15, standard EOQ with parameters as given in 
the model, BSAFE = .02. 

The user has the ability to specify initial stock 
conditions and also the probability distributions for the 
following variables 1 

1. Return of material to stock. 

2. Frequency of demand. 

3. Price change on receipt of material. 

4. Quantity demanded against individual items. 

In addition, the user may wish to simulate other types of 
transactions than are provided for in the model. The 
program modification in this case would be left to the 
user. To allow flexibility in introducing new subroutines 
to extend or change the model, the following pseudo-random 
variate generators are available as simple PL/I function 
calls 1 

1. Uniform. 

2. Normal. 

3. Poisson. 

4. Geometric. 
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5 . Gamma . 

6. Binomial. 

7. Hypergeometric . 

8. Log-Normal. 

9. Negative Binomial. 

10. Exponential. 

The index of the random variate generator in the 
above list corresponds to the value of the exogenous 
variable X (see page 9 )• 



III. THE PRESENTATION TO THE DECISION MAKER 



The simulation statistics that are available on a 
monthly basis are shown in Figures 2, 3* and. 4. Figure 1 
is a three-dimensional representation of how data are 
collapsed into the matrix in Figure 2. The matrix entries 
correspond to the number of line items which fell into that 
matrix element as of that point in time. The vertical 
columns, or categories, are totaled to show the number of 
line items in each price-demand category. The totals at 
the bottom of the figure are sub-tabulated by the price- 
demand categories. Only the total investment figure is 
scaled. A scale of 100,000 was applied to this due to 
restrictions on the allowable number of characters per line 
on the display surface of the cathode ray tube. A total 
investment of $423,251.81 would, therefore, be reflected 
as $4.23. 

Figure 3 is a tabular monthly recapitulation which 
is ordered by several of the statistics of interest. This 
is the counterpart of Figure 4 which shows one statistic 
across all policies as a bar graph. The printed bar graphs 
are produced monthly for lost sales, purchase order gener- 
ation, total investment and stock availability. 

Once the printer output was specified, it was 
natural to attempt to reproduce this presentation on 
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<$100 >$100 and >$1000 

<$1000 

> _ - 



ANNUAL DOLLAR DEMAND 



Fig. 1. — Three-dimensional representation of Figure 2 
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MONTH 16 



POLICY 2 



PRO0LEM • 13 



ANNDA L DOLLAR DEMAND 
4 VI I L A 9 ILTT T 

< 70% 

> 70% to < 75% 

> 75% to < 80% 

> 80% to < 85% 

> B5% to < 90% 

> 90% to < 95% 

> 9 C % to < 100% 
CATEGORY TOTALS: 



°NI T PRICE < 525 
> 5100 6 < *1,000 



H«jTf prIce > *25 



TO^AL NUMBER OF IT^MS: 



CATAGORY 



2 

J 

4 



LOST SALES 
f.00 
* 6.78 
*16,583.44 
* 125, 400. 56 



AVAILABILITY 



99.23 

93.97 

93.69 



TOTAL 



INVESTMENT 

t.01 



*.02 
*1 .O'' 
*3.66 



overall; 



*162,070.75 



92.90 



CUMULATIVE NUMBER OP PCFCHASE ACTIONS POR THIS POITCY = 57 

CUMULATIVE NUMBPF OP TRANSACTIONS GENERATET UNDER THIS POLICY = 19 31 



Fig, 2, --Detailed, listing of simulation results 
by policy within month 
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another device for the experiment. The experimental 
machine was chosen to be the IBM 2250 Model 1 cathode ray 
tube display device. ^ See Figure 5. This particular 
device is program controlled from the multiprogramming 
environment of the IBM System 360 Model 40 computer at the 
University of North Carolina Computation Center. A program 
was written to take the data output of the simulation 
program and mimic the printer output formats on the display 
device. Some exploration of the power and utility of such 
a display device was made within the confines of the 
desirability of maintaining similar presentation format for 
experimental design purposes. Figures 6 and 7 are the 
display device representations of Figures 2 and 3 and show 
some rearrangement of material due to display character and 
line number limitations . ? Figure 8 shows the first marked 
departure from the printer output of Figure 4. The layout 
is essentially the same, but the presentation is dynamic. 

A programmed timer was specified in the display program to 
advance all lines of the bar graph simultaneously at one 
second intervals. If the user specifies a month at which 
he wishes to examine the data, and then specifies the bar 

^International Business Machines Corporation, 

IBM System/360 Component Description. IBM 2250 Display 
Unit Model 1 , Form A27-2701-1 (January 27, 1967 ). PP. 5-37. 

7 1nternational Business Machines Corporation, 

IBM System /360 Operating System, Graphic Programming 
Services for IBM 2250 Display Unit , Form' C27-6909-4 
(December I 967 ), p. 14. 
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Fig. ?• — Display of Figure 3 
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graph he wishes to see, the graph begins at month 1 and 
then advances at one second intervals to the month 
requested. The user may also specify half-second intervals 
by a light pen detect. It is Intended that this movement 
of the bar graph give a feeling for the history and current 
derivative of the statistic under scrutiny as well as the 
static numeric results of the simulation. In addition to 
the movement of the bar graph, the symbols > , -< and = 
are used on the display unit to indicate whether the value 
of a particular bar has increased, decreased or remained 
equal in comparison with the previous month. 

Figure 9 has no printed correspondent in this 
experiment. While the data for cost of lost sales, 
availability, total dollar investment and number of pur- 
chase actions generated are available as individual bar 
graphs as represented by Figure 8, all four of these are 
available at the same time in the Quadrant Graph. All 
move simultaneously under the same program timer control 
as the individual graphs. Each graph is scaled uniquely 
and, of course, represents the same data as are available 
on the individual graphs, but with the obvious reduction 
in resolution since each line of a graph has only approx- 
imately half the width of the display device screen to 
represent the data as does the individual graph. 

Figure 10 depicts the Program Function Keyboard (PFK) 
which is the means by which the user indicates to the 
computer what he wishes to see on the display device. 
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Fig. 9. — Quadrant graph of simulation results 
by month across all policies 
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Fig. 10. — Programmed function keyboard 
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Key 0 will always display the user instructions if the 
plastic overlay, with no sense switch cut-outs,® is in 
place. Otherwise, key 0 will return control to the 
graphics monitor. 

There is a two-step procedure for obtaining a 
display i 

1. Indicate which month is to be seen. 

2. Indicate the display data desired. 

In order to prevent inadvertent display of data 
beyond the month desired, month change was set up as a two- 
step action. First, key 30 must be depressed (at which 
time a tone signal is heard), then the key corresponding 
to the month is depressed. This key is lighted by program 
control as a reminder to the user of his simulated month of 
furthest advance. At this time, no change is noted on the 
display device screen. When a key corresponding to a 
display is depressed, the display then changes. Keys 1-12 
will display Figure 6 for policies 1-12 for the month 
indicated. Keys 13-24 will be ignored by the program at 
this point. Note that keys 1-24 signify different events 
depending on whether they are immediately preceded by a 
key 30 depression or not. Key 25 will produce Figure 7. 
keys 26-29 will produce Figure 8 for Availability, Cost of 
Lost Sales, Purchase Actions Generated, and Total Dollar 
Investment respectively. Key 31 will produce Figure 9* 

®IBM, Component Description , pp. 30-32. 



The user is allowed to refer to any past month's data, 
may not, however, move ahead in simulated time by more 
one month at a time. 
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IV. THE SUBJECTS OF THE EXPERIMENT 



The experiment was designed to examine the decision- 
making processes of experienced, practical and interested 
professional administrators of inventory control, to find 
out if graphical display devices do, in fact, assist the 
decision-making process. The subjects were solicited in 
such a way as to insure a professional audience. The 
short course was designed as a graduate-level course which 
would attract only those who were interested in the subject 
matter and who were prepared to understand the material. 

The simulation model was the experimental vehicle and was 
used in examples and problems which were integrated into 
the course. The participants came to the course in statis- 
tical inventory control for their own professional advance- 
ment, under the auspices of the firms for which they worked. 
The participants were not informed of the experiment which 
was being conducted, and they received the full measure of 
instruction for which they came. The control of the human 
factors in the experiment proceeded quite smoothly with 
nothing to indicate bias or data contaminated by the fact 
that an experiment was in progress. 

The individuals who comprised the experimental 
group were solicited from nearby major manufacturing 
concerns specifically for the short course in statistical 
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inventory control. It was requested that candidates for 
the course have experience in inventory control and be in 
a decision-making position in the company. No more than 
two candidates were to be sponsored by any one company. 
The following firms sent people to the course: 

Burlington Hosiery, Burlington 
Burlington House Division, Burlington 
Cardinal Products, Durham 
Coca Cola, Durham 

Golden Belt Manufacturing Company, Durham 
International Business Machines, Raleigh 
Kayser-Roth Hosiery, Burlington 
Liggett and Meyers, Durham 
Sears Roebuck, Greensboro 
Sperry Rand, Durham 
Virginia Mills, Swepsonville 
Westinghouse Electric, Raleigh 

The participants attended the course between the 
hours of 9:00 and 11:00 A.M, weekdays for a two-week 
period. The morning hours were chosen specifically to 
insure that the attendees would have the active concur- 
rence and support of their sponsoring firms and would be 
scheduled for this absence from their regular duties. 

After a random division into two groups of nine 
individuals each, the following statistics applied to the 



individuals : 
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Individual 


Years Experience Automated Inven- 
in Inventory tory Control 

Control Experience 


Presently 

in 

Decision- 

Making 

Capacity 




Group 


I 






A 


20 




No 


Yes 


B 


15 




No 


Yes 
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20 




No 


Yes 


D 


12 




Yes 


Yes 


E 


1 




No 


No 
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5 




Yes 


• Yes 
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10 




Yes 


Yes 


H 


1 




Yes 


Yes 


I 


2 




No 


Yes 




Group 


II 






J 


5 




Yes 


Yes 
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1 




No 


No 
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5 




Yes 


Yes 
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0 




No 


No 
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2 




No 


Yes 


0 


20 




Yes 


Yes 


P 


6 




Yes 


Yes 


Q 


2 




No 


Yes 


R 


2 




No 


Yes 


After 


a substantial part 


of the course 


material had 



been given, the participants were given either a problem 
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book with twenty-four months of simulation output (Figures 
2, 3» and 4) or assigned to work a problem on the display 
unit at individual laboratory sessions. The second problem 
was assigned later in a similar manner except the groups 
now used the presentation method that they had not used on 
the first problem. It was explained that congestion on the 
display unit precluded everyone working both problems in 
this way. There was no attempt made to identify individ- 
uals by group membership or emphasize this distinction. 

The participants were not graded on these problems 
and were encouraged to work them as part of the education 
process of the course to investigate some of the funda- 
mental properties of the inventory control policies. 
Although all of the inventory control policies simulated 
for the two problems were discussed in class, the partici- 
pants were not given the correspondence to identify 
specific policies by number on the problem to avoid obvious 
bias. The participants, then, were asked to make their 
judgment based solely on the evidence without subjecting 
them to the prejudice of pre judgment. The two problems 
were of equivalent difficulty, the only distinction being 
the order in which they were presented. 

An operational environment was explained for the 
problem. Higher level management had presented the parti- 
cipant with the output data for the set of twelve inventory 
control policies, and had requested a recommended ranking 
so that an implementation of policies could be decided 
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upon. The participant was encouraged by management to 
present his recommended ranking as soon as possible, but 
cautioned that implementation of the recommended policies 
could have serious repercussions in the firm, so his best 
professional judgment was required. Figure 11 was the 
work sheet to be used. Participants were told to ignore 
the first two items in the top line as they had no rele- 
vance in this problem (Group #, USING:). Participants were 
reminded to keep accurate figures on elapsed time spent 
studying each month's data, and were also reminded to mark 
the decision month at which they would have presented that 
ranking as a recommendation to higher level management, 
prior to completing the rest of the form. 

In this experiment there were two possible ap- 
proaches to the problem of evaluating the quality of the 
decisions made. The first and most commonly used approach 
is to establish and furnish the subjects with the criteria 
of excellence which is to be used in evaluating the 
decisions. For example, in many cases the subjects are 
first given instruction, then tested to ascertain how well 
they perform as measured against the pre-established 
criteria. 

This method of measurement may be dependable when 
the material is objective and the criteria are easily 
established. In inventory control (and many other prob- 
lems) the weightings to be used in reaching a decision are 
highly individual. For example, one firm may emphasize 



OSIBG : PI S PUT / PRIBTOtTT 



START TIRE 



PBIRT TOPR IRITIALS 



rorth: I 1 


1 2 


1 3 1 «* 


1 5 | 6 | 


7 | 0 


1 4 


1 m 


1 11 


M2 |13 


|14 I IS | 16 


|17 | 10 |19 


120 |21 122 | 2 1 | 24 


i 


ORPER * AC H PORTE, | 


B!STi_ 




1 __l_ 


1 1 1 


1 


| 




1 


I .1 


.!_ l, i_ 


| 


1 


1 


1 1 1 . 1 1_ 


■ i 


BARR ’’’H E POLICIES | 


2RD | 


1 


i_ J 


.J 1 J. 


1 


| 




| 




1 1 1 


1 


1 


1 


1111 I 


i i 


EROR P* ST TO BORST. I 


1RP| 




l l 


1 1 1 


1 


| 




| 


1 1 


>11, 


1 


1 


1 , 


1 1 1 1 l _ 


i i 


TH*R E 1 TE B T RE TI RE | 


BTHJ__ 


_J 


.J J 


- 1 1 . L_ 


1_ 


1 




| 


1 _ _ 1 _ 


J . 1 1 


1 


| 


J 


1 1 11 1 


i i 


BEFORE GOIRG OR TO | 


5TB J , 


l_ _ 


i 1 


I 1 i_ 


1 


| 




1 


1 1 


_1 l 1 _ 


. 1 




1 . 


11 1 1 1 


i i 


REIT RORTH'S PATH. | 


6TH i 


_J 


_i_ | 


1 1 1 


1 


| 




| 


l_ 1__. 


,i_ 1_ i 


I 


_ 1 


1 


1111 1 




1 


7TH]__ 


| . 


l i 


i 1 i 


1 


| 




| 


1 1 


1 1 1 


I 


1 _ 


1 


ii . i i i 


1 i 


1 


STB I 


_ 1 _ _ 


.J 1 


.1 i_ | 


1 


| 




| 


.1 l 


i l i 


| 






i i ii i 


I 1 


1 


STB 1 1 


.1 1 




__J 


. 1 , . . 




1 


-J- l 


.1 1 i 


1 




_J 


i_ l- 1 J__ 1 


i i 


1 


10TH J 


_i_ 






_.J 






J. 


i 


.J J L_ 


1 


1 


_J 


J J J J j 


i 1 


1 


11TB I 


1 





.J 




.J 


J 1 


.J 1 


J J J 






,_J 


liiii 


i i 


I NOB ST 1 




.J_ J 


.J 


l 


1 




J 


i l 


I t L _ 


1 


1 




l_ 1 i_ _i i 




CLOCK 


TIEE | 




i 1 


1 11 




| 




1 


1 1 


1 1_ i_ 


.1. 






ii i_ i i 


l i 


RABK IR TBIS ROB 






.1 


.i 1 J. 


~J 






| 


.J 1 


.J 1 L 




1 — 


— 1 


J 1 J J 


J 1 



PBPIR TR ROBTB IB IB ICH 
TOO BATE RAPE A El HAL 
DBCISIOR BEFORE OOIRG 
TBBODGB REST OE DATA TO 
CBECE OPT TOOR OICISIOB. 



Fig. 11. — Data collection format 
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high availability, whereas another may give heavy weight 
to low investment. When the experimental subjects are 
experienced in the field and have developed their own 
criteria for decisions, the method of measuring against 
instructor-set criteria is unsuitable. One cannot know the 
extent to which the subjects followed the instructor's 
criteria and the extent to which they followed their own. 

A distinguishing feature of this experiment is that 
it took an alternative approach to the problem of evaluat- 
ing the quality of decisions. The subjects were well 
acclimated to the decision process by experience, and were 
familiar with and interested in the substance of the 
course. Therefore, they were given no weightings, no 
criteria of excellence by the instructor. Instead they 
were explicitly told to apply their own several diverse 
sets of criteria. The quality of their decisions was then 
measured by the consistency of each subject's own ranking 
at the month of commitment with the later ranking when full 
information was available. 

Although this second approach diminishes the mean- 
ingfulness of comparisons which show how well the subjects 
agree with each other, such measures were taken as a matter 
of interest. The use of self-consistency rather than 
artificial criteria does, however, improve the credibility 
of the other statistics. It also substantially improves 
the generalizability of the results, for it shows the ef- 
fect on decision makers when deciding by their own 



standards, rather than by those dictated by a simplified 
theoretical model. In substance, we have separated the 
decision process from the classroom environment and 
Inserted it into an operational environment. 



V. THE DESIGN OF THE EXPERIMENT 



Two main analyses were performed on the data: an 

analysis of variance of the Latin square design, and a 
computation of rank order statistics. We will first turn 
our attention to the Latin square design. 

The concept of a generalized Latin square design is 
traditionally introduced by explaining a checkerboard 
pattern of equal-area plots of land used in agricultural 
experiments. If we are investigating the effect of soil 
treatment on the yield of a crop, the plots are chosen at 
random in such a way that every row and every column is a 
complete replication, which is to say that each treatment 
will occur once and only once in each row and each column 
on the checkerboard. In an experiment, this design tends 
to avoid any systematic variations in effects, such as local 
soil variations, which are not due to the treatment. 

In the Latin square design of this experiment, it 
should be noted that instead of experimenting on different 
subjects in each cell of the square, the same experiment 
group was involved in both cells of a row. In effect, 
each group acted as its own control group. Experiments in 
which the same subjects are used under all q treatments 
require q observations on each subject, and are called 
experiments with repeated measures. In this experiment 
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q = 2 since we are dealing with two treatments and each 
subject is observed twice. This variation on the standard 
Latin square is described in detail on the following pages. 

The formal design proceeds from a specification of 
the model to an analysis of variance and hence of the 
significance of observed differences. In the analysis of 
variance, the sum of squares (SS) is computed for rows, 
columns and treatments. From this, a variance estimate, or 
mean square (MS), is calculated for rows, columns and 
treatments. This is accomplished by dividing each sum of 
squares by the degrees of freedom (df) corresponding to 
that sum of squares. From here an F test^ is used to find 
the significance level of the variation under investigation. 
We will be most concerned with the significance of any 
variance due to treatment. 





Order 1 


Order 2 
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Printer 


Display 



Fig. 12. — Latin square design 



The 2x2 Latin square with repeated measures^ 



^William L. Hays, Statistics for Psychologists 
(New York* Holt, Rinehart and Winston, 1963) . pp. 368-369* 

J. Winer, Statistical Principles in Experimental 
Design (New York» McGraw-Hill Book Company, 3 962 ) , 

PP. 338-543. 



47 



of Figure 12 was used to analyze the data for: 

1. Simulated calendar time to reach a decision 
(decision month), 

2, Actual elapsed time to complete the rankings 
through the decision month, 

3. Actual elapsed time to complete the problem 
after the decision month, 

4, Correlation coefficients for the consistency of 
the committed decision with the final ranking, 

in order to produce an analysis of variance of these 
statistics , 

The particular design was chosen in part to isolate 
that variation due to natural differences between the 
experimental groups. As can be seen below, the separation 
of the source of variation due to group differences allows 
a better measure of that variation due to the form of data 
presentation, which is the statistic of real interest. An 
appropriate model for this 2x2 Latin square design is:^ 

E <W =^ + ^ k +7r m(k) + «‘ 1 ctf 



In Cl] , A* is the grand mean, represents the 

k 

effects associated with groups, 7T /, \ the effects 

1 m(k) 

associated with subjects within groups, oC ^ the effects 
due to the order in which each subject did the two exper- 
iments and /3 the effects due to the form of data 

J 

presentation. The analysis and expected values of the mean 



i:L Ibid. . p. 539 
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squares are shown in Figure 13, for the 2x2 case of the 
p x p Latin square with n observations in each cell. Here 
A and B represent the factors associated with the d and/3 



effects . 

Schematically the experiment may be represented by: 
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Fig. 13. — Analysis of the 2x2 Latin square design 



The computational procedure for the analysis of 
variance involves a straightforward partition of the total 
sum of squares. 12 For this particular Latin square design, 
the computation is as follows* 

Correction Factor G 2 /np 2 T2j 

Total SS £X 2 [3] 

■*- 2 Hays, Statistics for Psychologists , pp. 356-375* 
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Order £ A^/np [ 4j 

Treatment ^.B 2 /np [5] 

Cell Total 2 £(AB..) 2 /n [ 6 ] 

i J 

2 

Paired Observations ^P m ^^/p C 7j 

Row ^.C^/np [ 8 ] 

SS a = [43 - [2] [ 9 ] 

SS b = [5] - [2J [10] 

SS groups = ^3 “ 

SS subj . w. groups = [^1 “ [12] 

SS error (within) = ~ Tl3j 



The summations in all cases are over the whole experiment. 
P m (k) represents the sum of the q observations on person m 
in group k. G is the grand total; A, B, C, represent the 
sum of the np observations for their corresponding sources 
of variation. 

The ratio for the F test is computed for each 
source of variation in the usual manner by taking the ratio 
of two mean square values of interest. F(u,v) will desig- 
nate the F value where u is the number of degrees of 
freedom in the numerator of the ratio and v the number of 
degrees of freedom in the denominator. F(l,l 6 ) then for 
this experiment is: 

F(1,16) = MS a /HS error(wlthin) 

F(1,16) = MS b /MS error(wlthln) 

/MS , 

groups subj w. groups 




F(l,l 6 ) = MS 
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In order to test the error term for homogeneity of 

variance, [JL21 is also computed so as to provide the parts 

13 

that may be checked by an F_ Q „ test. ^ This is accom- 

illcAX. 

plished by summing only over Group I and over Group II 
rather than over the whole experiment. In this way the twc 
components so derived for [13] are tested at F(8,8) for an 
appropriate significance level. The magnitude of this F 
ratio indicates the extent to which the observed data con- 
form to the model, and thus provides a partial check on the 
appropriateness of the model. 

Since the values of the decision month are positive 
integers, a skewed distribution was suspected and found to 
be present. The nature of the decision is also such that 
higher variances would be expected to be associated with 
higher means. The values were, therefore, transformed 
following a standard procedure by taking the square root, 

to make the variances more homogeneous and at the same 

14 

time to normalize the distribution. It is this square 
root value which is used in the analysis of variance 
computations, and reported in the tables. 

It is of interest to compare the rank order of the 
inventory control policies at the decision month and the 
rank order at the twenty-fourth month for each individual. 
This comparison gives a measure of each individual's 

1 3winer, Statistical Principles , pp. 92-96, 5^2. 
l4 Ibid. . pp. 218-222. 



